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Abstract 

We consider the physical model of a classical mechanical system (called 
"small system") undergoing repeated interactions with a chain of identical small 
pieces (called "environment"). This physical setup constitutes an advantageous 
way of implementing dissipation for classical systems, it is at the same time 
Hamiltonian and Markovian. This kind of model has already been studied in 
the context of quantum mechanical systems, where it was shown to give rise to 
quantum Langevin equations in the limit of continuous time interactions {[21), 
but it has never been considered for classical mechanical systems yet. The 
aim of this article is to compute the continuous limit of repeated interactions 
for classical systems and to prove that they give rise to particular stochastic 
differential equations in the limit. In particular we recover the usual Langevin 
equations associated to the action of heat baths. In order to obtain these 
results, we consider the discrete-time dynamical system induced by Hamilton's 
equations and the repeated interactions. We embed it into a continuous-time 
dynamical system and we compute the limit when the time step goes to 0. This 
way we obtain a discrete-time approximation of stochastic differential equation, 
considered as a deterministic dynamical system on the Wiener space, which is 
not exactly of the usual Euler scheme type. We prove the and almost sure 
convergence of this scheme. We end up with applications to concrete physical 
exemples such as a charged particule in an uniform electric field or a harmonic 
interaction. We obtain the usual Langevin equation for the action of a heat 
bath when considering a damped harmonic oscillator as the small system. 
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1 Introduction 

In order to study open physical systems, that is, systems in interaction with a large 
environment, two main approaches are often considered. The first one is Hamil- 
tonian, it consists in describing completely the small system, the environment and 
their interactions in a completely Hamiltonian way. Then one studies the associated 
dynamical system. The other approach is Markovian, it consists in giving up describ- 
ing the environment (which is too complicated or unknown) and to describe only the 
effective action of the environment on the small system. Under some assumptions 
on the environment, the evolution of the small system is a Markov process. One 
can then study this Markov process with the associated probabilistic tools (invariant 
measure, etc). 
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In the context of quantum mechanical systems, S. Attal and Y. Pautrat propose 
in [2] a new type of model for the interaction of a small system and the environment: 
the scheme of repeated interactions. In this setup, the environment is regarded as 
an infinite assembly of small identical pieces which act independently, one after the 
other, on the system during a small time step h. This approach has the advantage of 
being in between the two previous approaches: it is Hamiltonian for each interaction 
of the small system with one piece of the environment is described by a full Hamilto- 
nian, it is also Markovian in its structure of independent and repeated interactions 
with fresh pieces of the environment. 

This approach, in the quantum context, has also the advantage to give rise to a 
rather workable way of implementing the dissipation. It is physically realistic for it 
shown in |2] that, in the continuous interaction limit {h tends to 0) the associated 
dynamics converges to the usual quantum Langevin equations associated to open 
quantum systems. 

Our aim in this article is to consider this scheme of repeated interactions, and its 
continuous time limit, for classical physical systems. 

S. Attal describes in [Ij a mathematical framework for classical systems of re- 
peated interactions. His construction is based on a strong connection between 
Markov processes and dynamical systems that he describes; we present it in Sec- 
tion 2. The main idea is that Markov processes are all obtained from deterministic 
dynamical systems on product spaces when ignoring one of the two components. In 
particular stochastic differential equations can be seen as deterministic dynamical 
systems on the state space times the Wiener space. 

The dynamical system associated to repeated classical interactions is discrete in 
time, depending on the time parameter h. If one wants to consider all these dynamical 
systems for all h and their continuous limit, when h tends to 0, we have to embed 
discrete time and continuous time dynamical systems into a common natural setup. 
This is what we develop in Section 3. 

Section 4 is devoted to presenting several physical exemples to which our main 
theorems will be applied at the end of the article. 

The convergence of the discrete dynamical systems associated to classical re- 
peated interactions is carefully studied in Section 5. More precisely, the evolution of 
the system undergoing repeated interactions shall be represented by a Markov chain 
(X^^). The study of a limit evolution comes down to the convergence of a linearly 
interpolated Markov chain to the solution of a stochastic differential equation. In- 
deed, the embedded dynamics lead to consider the linear interpolation of (X^^), i.e. 
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the process (X^) defined by 

The main theorems of Section 5 are concerned with the convergence of this process 
{X^) under some assumptions. Theorem 5.2 shows the and almost sure conver- 
gences when the evolution of the Markov chain is given by 

The limit process is the solution of the stochastic differential 

dXt = b{Xt) dt + a{Xt) dWt 
when the applications b and a are Lipschitz, and when r]^'^^ satisfies 

\r]^''\x,y)\ < |x| + \y\). 

All these results are then applied in Section 6 to the physical exemples previously 
presented in Section 4. 



2 Dynamical Systems and Markov Processes 
2.1 Discrete Time 

A connexion between deterministic dynamical systems and Markov chains has been 
recently presented by Attal in P]. He shows that randomness in Markov chains ap- 
pears naturally from deterministic dynamical systems when loosing some information 
about some part of the system. In this section, we present the context and the main 
results of [1]. 

A discrete time dynamical system is a measurable map T on a measurable space 
{FjJ-"). The dynamics of this system is given by the sequence (r")^^^* of iterations 
of T. From this map T, one can naturally define a map T on C°°{F,J^), the set of 
bounded functions on F, by 

Tfix) = /(f (x)) , 
for all / in C°° {F, and all x in F. 

Now consider a dynamical system T on a product space S x E where {S,S) and 
{E, S) are two measurable spaces. Furthermore, assume that {E, £) is equipped with 
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a probability measure /i. Physically, S is understood as the phase space of a "small" 
system and E as the one of the environment. Let T be the application on C°°{S x E) 
induced by T. 

The idea of the construction developed in [1] is to consider the situation where 
one has only access to the system S and not to the environment E (for example E 
might be too complicated, or unknown, or unaccessible to measurement). One wants 
to understand what kind of dynamics is obtained from T when restricting it to S 
only. 

Consider a bounded function / on S, we naturally extend it as a (bounded) 
function on S x E hy considering 

{f®l){x,y) = f{x), 

for all X in S, all y in E. That is, the function / made for acting on S only is seen 
as being part of a larger world S x E. 

The dynamical system T can now act on /(8>1. We assume that what the observer 
of the system S sees from the whole dynamics on S* x is an average on E along 
the given probability measure /i. Therefore, we have to consider the application L 
on C^{S) defined by 

Lf{x)= [ T{f^l){x,y)dM. 

J E 

Note that Lf also belongs to £°°(S'). This operator L on C^{S) represents the 
restriction of the dynamics T on 5*. In other words, we have the following commuting 
diagram : 

£~(5 X E) C°^{S X E) 

£°°(5) > £°°(5) 

It is natural now to wonder what is the nature of the operator L obtained this way. 
In [Ij the following result is proved. 

Theorem 2.1. There exists a Markov transition kernel 11 such that L is of the form 

Lf{x)= [ f{z)U{x,dz), 
Js 

for allfeC^iS). 
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Conversely, if S is a Lusin space and 11 is any Markov transition kernel on S , 
then there exist a probability space {E,S,n) and a dynamical system T on S x E 
such that the operator 

Lf{x)= [ f{z)U{x,dz), 
Js 

is of the form 

Lf{x)= [ T(/®l)(a;,y)d/i(y) 
Je 

for all f eC^{S). 

The mapping L on the system S is not a dynamical system anymore. It represents 
the part of the dynamics on the large system S x E which is obtained when observing 
5* only. The main fact of the above result is that L encodes some randomness, while 
T was completely deterministic. This randomness arises from the lack of knowledge 
on the environment. 

Note that in the reciprocal above, the dynamical system T which dilates L is not 
unique. 

The Markov operator L obtained above comes from the projection of only one 
iteration of the dynamical system T. It is not true in general that if one projects 
the mapping on S one would obtain (see [1] for a counter-example). It would 
be very interesting to be able to construct a dynamical system T which dilates a 
Markov operator L not only for one step, but for all their powers and L^. This 
would mean that we have a whole dynamical system (T'^)^^^ which dilates a whole 
Markov chain (L'^)^^^ when restricting it to S. This is to say that one wants the 
following diagram to commute for all A; G N: 

C^iS X E) C^^^S X E) 

m 

As explained in [T] this can be obtained through the scheme of repeated interactions, 
as follows. 

Let T be a dynamical system on S x E which dilates a Markov operator L. Since 
T is a measurable map from S x E to S x E, there exist two measurable applications 
U and V such that, for all x in S*, all ?/ in ii^, 

f{x,y) = {U{x,y),V{x,y)) . 



Ie- <^i^ 
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Now, consider the space E = E endowed with the usual cr-field S and the 
product measure Jl = /i*^^ . From the map T, one defines a djTiamical system T on 
the space S x E hj 

f{x,y) = iUix,y,),eiy)), 
for all X in S, all sequence y = (?/m)meN* in E, where 6 is the shift on E, that is, 

^iy) = (ym+i)meN* • 

Physically, this construction can be understood as follows. The system S is in inter- 
action with a large environment. This large environment is a chain E made of copies 
of a small piece E. One after the other, each part E of this environment interacts 
with the system 5*, independently from the others. This is the so-called "repeated 
interactions scheme". 

Note that the application V doesn't appear in the definition of T. From the 
physical point of view this is natural, the map V gives the evolution of the part E 
of the environment which acts on the system. As this part shall not be involved in 
the dynamics of the system 5*, its new state has no importance for the system. 

As previously, the mapping T induces an operator T on C°°{S x E). Then, the 
following theorem (proved in [Ij) shows that the sequence (T^) of iterations of T 
dilates the whole Markov chain {L^)km- 

Theorem 2.2. For all m in W , all x in S, and all f in £,°°{S), 

{L^f){x)= [ T^{f®l){x,y)djl{y)- 

J E 

The operator L represents the action of a Markov kernel 11 on bounded applica- 
tions and the restriction of the whole dynamics given by T to S. On the other hand, 
the Markovian behaviour on applications associated to the action of 11 can be also 
seen on points when focusing on the dynamical system T. Indeed, for all initial state 
X of the system in S*, and all state of the environment y m E, the evolution of the 
system is given by the sequence defined by 

x:^,{y) = u{x^M.yn+i). 

with Xq = X. Now if the state of the environment is unknown, the dynamics of the 
system is represented by the sequence of applications from E to S. This 

sequence (X^) is a Markov chain. Furthermore, the Markov transition kernel of (X^) 
is n again. 
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Note that the whole dynamics of T can be expressed from this sequence {X^) as 
follows. For all in N, all x in S", and all y in E, 

f\x,y) = {Xl{y),e\y)), 

where 9^{y) is the sequence y which is shifted k times, i.e. 9^{y) = {yn+k)nm*- 

Note that sequences are indexed by N* in this scheme of repeated interactions. 
Physically, this can be understood as repeated interactions between the systems 
which last for a time duration 1. Now, a new parameter h is added. It represents 
the time step for the interactions. Henceforth, all the sequences are now indexed by 
hW. 

For instance, the dynamics of the system is now given by the Markov chain 
{X^J)nm defined for all starting state x by 

with Xq'^^ = X. 

The dynamical system given by the scheme of repeated interactions is now 

fW(a;,y) = (f/W(x,y,),^(^)(l/)), 

where 6'(^) is the shift, i.e. 6^'''>{y) = {y{n+i)h)neN*- 

Note that the application t/'-^^ can also depend on the time step h. We shall see 
in the exemples of Section 4 explicit expressions for this map in some physical 
situations. 

Our aim is now to understand what can be the limit dynamics of these repeated 
interactions when the time step h goes to 0. 

Attal and Pautrat, in [2], have studied open quantum systems with an equivalent 
setup of repeated interactions. They show the convergence of repeated interactions 
to quantum stochastic differential equations. In section 5, we shall see that the limit 
evolutions in the classical case are solutions of some stochastic differential equations. 
Therefore, we shall need to extend our parallel between Markov chains and dynamical 
systems to the continuous time setup and in particular to solutions of stochastic 
differential equations. 

2.2 Continuous Time 

As previously seen, from a Markov operator L, with the help of repeated interac- 
tions, one can construct a dynamical system which dilates the whole sequence (L^). 
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Moreover, the evolution of the first component is given by a Markov chain associated 
to the Markov transition kerneL We wish to extend this idea to Markov processes 
which are solutions of stochastic differential equations. 

A continuous time dynamical system is a semigroup of measurable applications 
{Tt)teR+, that is, which satisfy Tg oTt = Tg+t , for all s, t in R"*". 
Consider now a stochastic differential equation (SDE) on M™, 

dXt = h{Xt)dt + a{Xt)dWt, (1) 

where Wt is a d-dimensional standard Brownian motion, h and a are measurable 
functions respectively from to M™, and from to M.rn,d{^i the space oi mx d 
real matrices. We want to create an environment Vt and a deterministic dynamical 
system (Tj) on M™" x Vl which dilates the solution and such that the first component 
of Tt is the solution of ([T]) at time t. 

However, we shall need existence and uniqueness of the solution of ([1]) at all time 
t and for all initial conditions. In order to guarantee that properties we have to make 
some assumptions on the functions h and a. We require them to be either globally 
Lipschitz, 

(HI) There exists K > Q such that for all x, y we have 

\h{x) - h{y)\ < Kq\x - y\ and \\a{x) - (j{y)\\ < Kq\x - y\ , 

or locally Lipschitz and linearly bounded, 

(H2) The functions h and a are locally Lipschitz: for all > 0, there exists Kj~^ > 
such that for all x,y & M{0, N) we have 

\b{x) -b{y)\< KN\x-y\ and \\a{x) - a{y)\\ < \x - y\ . 

(H3) Linear growth bound: There exists a constant Ki > such that 

\b{x)\ < Ki{l + \x\) and ||(T(a;) || < + , 

where |-| is the euclidean norm on M™' and || ■ || is the Hilbert-Schmidt norm on 
Mm,dO^) defined by 

d m 

j=i i=i 
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Note that Assumption (HI) implies (H2) and (H3). We differentiate the two cases 
because the convergences studied in section 5 shall be stronger for globally Lipschitz 
functions b and a. 

Note also that Assumption (HI) or Assumptions (H2) and (H3) are sufficient (see 
[5]) but not necessary. One can now construct the environment and the dynamical 

system. Consider the Wiener space {Q, J-", P) associated to the canonical Brownian 
motion [Wt). This is to say that Q = Co(M+, W^) is the space of continuous functions 
from to M.'^ vanishing at the origin. The canonical Brownian motion (Wt) is then 
defined by Wt{u!) = uj{t), for aA\ u e Q and all t G M+. 
Consider the shift Of defined on Q by 

et{uj){s) = uj{t + s) -uj{t). 

and the family of mappings (Tj)jgiR+ on x Vt defined by 

for all X G M"*, all w G fi, where Xf is the solution of (P) at time t, starting at x. In 
[1], Attal shows the following. 

Theorem 2.3. The family (Tf) on x Q is a continuous time dynamical system. 

Let us denote by Tt the map induced by Tt on /^""(M™). It induces a semigroup 
iPt)tm+ on £-(»-) by 

Pt{f){x) = E[Tt{f®l){x,-)] . 
The generator of this semigroup (Pj) is 

i,j=l i=l 

where a is the symmetric matrix aa^. 

3 Embedding Discrete Time into Continuous Time 

In order to prove the convergence of the discrete time dynamical systems, associated 
to repeated interactions, to the continuous time dynamical systems associated to 
solutions of stochatic differential equations, we need to explicitly embed the discrete 
time dynamical systems into a continuous time setup. 
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The state space on which the repeated interaction dynamical system T^^^ acts is 
X (R'^)™*, whereas the one of {Tt)teR+ is R"* x Q. The first step in constructing 
the embedding of dynamical systems is to construct an embedding of (R'')™* into 

n. 



3.1 Discrete Approximation of Q 

Let 0f ^ be the map from {W^)'"^* to ft defined by 

,(h)/ \ / \ t — \ t/h\h 

ri '{y)[t) ^ 2^ynh + y{[t/h}+i)h , 

n=0 

where yo — 0. This map (f)f'^ actually builds a continuous, piecewise linear, function 
whose increments are the elements of the sequence y. The range of is denoted 

by it is a subspace of 

Conversely, define the map (p^p^ from Q to (M'^)'^^* by 

In other words, the range of an element of Q by is the sequence of its increments 
at the times nh, for all n eW. Note that these applications 0^'*^ and (f)p^ satisfy 

Ah) ,{h) 

(pp o (py = la^d^hn* . 



In particular the map (f)} ' is an injection from (R")"'^ to Q, the spaces (R")"'^ and 
are in bijection through the apphcations 0^'*^ and (0p^)|n(/>). 

We now show that (R'^)'^^* can be viewed as an approximation of fl for the usual 
metric associated to the topology of uniform convergence on compact sets. For two 
elements cu and cu' in fl define the distance 



oo 



sup \uj{f ) — Uj'{f) I 

0</</i 



2" 1 + sup \uj{t) -uj'{t)\ ' 



""^ 0<t<n 



where |-| is the euclidean norm on R*^. The space fl endowed with this metric is a 
polish space. 



Lemma 1. For all cu E fl, 



lim D(uj,(f)f^ o(f)'^^\uj)) ^0. 
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Proof. This result is based on the uniform convergence of piecewise hnear appli- 
cations to continuous one on compact sets. Let a; be a function in Q. Then, by 
definition, 

0p\a;) {u{nh) - u{{n - l)h))nm* ■ 
Now the mapping is apphed to sequence (f)^p\oj). For all t in 1R+, we have 

[t/h] 

4>fK(t)f{u){t) = ^{u{nh)-u{{n-l)h)) + 



n=0 



+ 



h 



= u(lt/h\h) + {uj{{[t/h\ + l)h) - uj{[t/h\h)} . 

Note that (pf^^ o (f)p\uj){t) is a point in the segment u;{[t/h\h)) ,uj{{[t/h\ + j 
Since u) is continuous we have 



lim uj(\t/h\h) = \imuj((\t/h \ + l)h) = u(t) . 



Therefore, 



Let n e N, as [0, n] is compact the function cu is uniformly continuous on this interval. 
Thus, 

lim sup 

'^-^O 0<t<n 

On the other hand, note that 



0. 



sup 

0<t<n 



u:{t)-<t>fo<t>f{uj){t) 



1 + sup 

0<t<n 



u{t)-ct>fKct>^P{uj){t) 



< 1. 



Hence, by Lebesgue's theorem. 



□ 
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3.2 Embedding the Discrete Time Dynamics 

The first step in the construction of a continuous dynamics from T'^^^ is to relate it 
to a discrete time evolution on x Q. Since the apphcations 0^'*^ and (f)p are only 
defined on (R'')™* or Q, we extend them to W x (M'^)™* and R"' x Q, respectively, 

by 

Consider the dynamical system T^'*'* on M"* x Q given by 
As we have 

the following diagram is communting for all n > 1: 

x O ^ ^ x n 



hn* s. y (■ud\hn* 



We now relate this dynamical system to a continuous time dynamics, by linearly 
interpolating in time. Define a new family of applications (T^'^'')tgK+ by 

^(h) ^ ^^(fe) ^ LVftj ^ ^ - [t/h\h I ^-(?.) ^ ( Lj/^j +1) _ j^^(fc) Lt//.J I 
_ i\t/h\ + l)h-t ,Tp{h).\tih\ I \t/h\h .77^Wx(Lt/ftJ+i) 

where, by convention, {T^^^"^^ = Id. 

The projections on the first and the second component of are respectively 
denoted by xf'"* and 9['^\ More precisely, for all initial x € R and cu, the value of 
{x, uj) can be also expressed as 

Note that, in general, the family {Tf'^)teR+ is not a semigroup because of the 

linear interpolation. The random process X^''^ is not also Markovian but a linearly 
interpolated Markov chain. 
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Also note that the state of the environment for the evolution of the system is 
given by (f)^p\uj), i.e. by the increments of a continuous application of the Wiener 

space Q. 



convergence of ef> to the shift dt on n according to the metric D. 

However, before hands, we want to illustrate this framework and in particular 
the scheme of repeated interactions, through physical examples. 

4 Application to some Physical Systems 

As explained in the introduction, the main motivation for the study of repeated 
interaction schemes and their continuous limit is to try to obtain physically justified 
and workable models for the dissipation of a simple system into a large environment, 
such as a heat bath for example. 

4.1 Charged Particle in a Uniform Electric Field 

Consider a particle of charge q and mass m in an uniform electric field E in dimension 
1. Its energy without interaction with E is just kinetic, i.e. /2m. In the presence 
of the exterior electric field, the particule has a potential energy —qxE, where x is 
the position. Thus, the Hamiltonian of the particle is 



The dynamics of the particle is governed by Hamilton's equations of motion. 



Now we set up the scheme of repeated interactions. The small system is the particle. 
As it moves in dimension 1, the space S is endowed with its Borelian cr-algebra. 






These equations can be easily solved and give 
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The environment is the exterior electric field. Hence, the space E is M. Intuitively, 
the limit process shall be a solution of a SDE driven by a 1-dimensional Brownian 
motion (Wt). 

The environment of the discrete time dynamics at time step h is the set M™*. 
The interaction between the system and the environment is described as follows. 
At each time (n — l)h, the value of the electric field E{nh) is sampled from the 
increment W{nh) — W{{n— l)h) of the 1-dimensional Brownian motion. The system 
evolves during a time h according to the solution of the equations whose initial values 
x((n — l)h) and p{{n — l)h) and where the electric field is E{nh). After this time h, 
the interactions are stopped and one repeats the procedure. 

In particular the evolution of the system is given by the following Markov chain 



However, one has to make some renormalization somewhere. Indeed, when the 
time step h decreases, the effect of the electric field on the particle becomes smaller 
and smaller. To counter that, the interactions have to be reinforced. The electric 
field E is renormalized by multiplying by a factor 1/h. 

This normalization factor can be intuitively understood as follows. First if one 
wants to keep the same intensity (at least in law) for the interactions, a factor 1 / y/h 
is needed. On the other hand, one needs to renormalize with an other 1 / y/h as in 
the quantum case of |2], since the infiuence of the environment decreases with the 
time step h. Thus, the value of the electric field is now sampled from 1/h (W{nh) — 




qE{nh) 



2m 



p{nh) = p{{n — l)h) + hqE{nh) . 



W{{n-l)h)). 



Therefore, the new dynamics of the system is 




+ h 



qE{nh) 
2m 



In other words, using vector notations, the dynamics is 



X{nh) = U'-''\X{{n - l)h), E{nh)) 



where the map U^^^ is defined by 



y) = x + a{x)y + hb{x) + hr]'^^\x, y) , 
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with 



Xi 
X2 



Xi 
X2 



X2 

m 




2m 




4.2 Harmonic Interaction 

Our second example is another example where Hamilton's equations can be explicitly 
solved. 

Consider two unit mass systems linked by a spring whose spring constant is 1. 
Let I be the length for which the potential energy is minimum. We assume that the 
two objects can just horizontaly move without friction. 

In this case, the Hamiltonian of the two objects is 



H 



Qi 
Pi 



Q2 
P2 



p2 p2 1 



where Pi/ 2 is the kinetic energy of the system 1 and P2/2 the kinetic energy of the 
system 2. 

The dynamics of the whole system is given by Hamilton's equations 



4 = ^ = P. 



dPi 

dH 
dPo 



and 



and 



dH 
Wi 

dH 
dQ2 



^Q2-Qi-l 



-{Q2-Q1-I). 



These equations can be solved and give this evolution of the whole system according 
to the initial conditions. 

Qiit) =\ (^i(o) + ^2(0)) t + i(gi(o) + g2(o) - /)+ 

+ J(Qi(0) - Q2(0) + I) cos(v^t) + ^(Pi(0) - P2(0)) sm{^/2t) 
2 2v 2 

Pi{t) =^(Pi(0) + P2(0)) - ^(<9i(0) - ^2(0) + I) sin(V^i)+ 
+ ^(Pi(0)-P2(0)) cos(V2t) 
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Q2{t) =^(Pi(o) + P2(o))t + ^(gi(o) + Q2(o) + 0+ 

- ^(Qi(0) - Q2(0) + cos(v^i) - ^(^i(0) - ^2(0)) sm{V2t) 
P2{t) =^(Pi(0) + P2(0)) + ^(<3i(0) - ^2(0) + sm{V2t)+ 
-l(Pi(0)-P2(0)) cos(y2t). 

Let h he a fixed time step. As h is supposed sufficiently small, an approached 
expression of the discrete time dynamical system can be computed by a Taylor ex- 
pansion. 

On the other hand, as we shall be only interested in the dynamics of the system 
1, the evolutions of Q2 and P2 are forgotten. We get 

Qi{h) = QM + /iPi(O) + 1 {Q,{0) - gi(0) - /) /iV 

-^{P,{0)-p,{0))h' + o{h') 

p,{h) = Pi(o) + (g2(o) -Qm-i)h + ^ (P2(o) - Pi(o)) 

+ ^iQm-Q2{o) + i) h^ + o{h^). 

We now introduce the scheme of repeated interactions. System 1 is chosen as the 
small system. Thus, the space S is R^. System 2 plays the role of one piece of the 
environment. The space E is also in this case R^. 

At time nh, the small system is in the state Qi{nh) and Pi{nh). The values of 
Q2{{n + l)h) and P2((n + l)h) are sampled from the increments of a 2-dimensional 
Brownian motion Wt- One makes the system and the environment interact during a 
time h with the initial conditions for the environment Q2{{n+l)h) and P2{{n-\-l)h). 
The interaction is stopped after a time h. One then repeats the procedure. 

However, for the same reasons as for the first example, interactions need to be 
renormalized by a factor 1/h. The Markov chain which gives the evolution of the 
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system becomes 



Qi{nh) = Qi{{n - l)h) + (p^{{n - l)h) + ^Q2{nh)y+ 

-^-{Q,{{n-l)h) + l-^^)h' + oih') 

Pi{nh) = Pi{{n - l)h) + Q2{nh) - (Qi{{n - l)h) + I - ^P2{nh)'^h+ 

_/A((n-l)/.)^g^x 
\ 2 3 / 

or, equivalently 



where 



with 



and 



X{nh) = U^^\X{{n-l)h),Y{nh)) 



U^^\X, y) = X + a{X)Y + hh{X) + hr]^^\X, Y), 



Xl \ X2 \ ( = ( ^ ^ 

X2 J V -(^1+0 J' "{^2 J \l 



Note that this apphcation U^'^^ is of the same form as in the case of the particle 
in an uniform electric field. 

Note also that the renormalization can be understood in a more general way as 
follows. In the two examples above, the interactions are reinforced by changing the 
states of the environment in the scheme of repeated interactions. But, in the same 
way as in the quantum case, the renormalization can be understood as a reinforce- 
ment of the interaction in the Hamiltonian. 

Indeed, the Hamiltonien of the whole system can be written in general way, 

H= Hj^+ H2^ + ^ > 

System Environment Interaction 

where Hi is the part of the Hamiltonian which only depends on the state of the system 
{ Pi /2+Q\/2 for instance in the case of the harmonic interaction), i72, the part which 
only depends on the state of the environment (P2^/2 + (5i/2) and the interaction part 
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/ which really depends on the two states {—QiQ2)- Our renormalization factor can 
be viewed as a reinforcement of the interaction term I by multiplying it by this factor 
1/h. Then, the scheme of repeated interactions is set up from this new Hamiltonian 
which depends on h. 



4.3 Damped Harmonic Oscillator 

The formalism developped in Section 2 is general and it can also be applied to non- 
Hamiltonian systems. An example based on a change of the harmonic interaction by 
adding a friction term for the system is presented in this part. 

Consider the same system as previously, i.e. two harmonically interacting objects 
of mass 1. We assume that the system 1 also undergoes a fluid friction in —/Pi 
where / is the friction coefficient. Because of this force, the energy is not conserved, 
and therefore, the system is not Hamiltonian. Moreover, in order to simplify the 
interaction, the length I of the minimum of the potential energy is supposed to be 0. 

The evolution of the system follows Newton's law of motion, 

Qi = Pi 

Pi^-fPi + Q2-Qi. 

On the other hand, the environment part stays Hamiltonian and evolves according 
to the equations 

P2^Ql-Q2. 

For a small time h > 0, Taylor's expansions and the previous equations lead to a 
state of the system after a time h 

' Qi{h) = Qi{0) + hPi{0) + 0{h^) 

P,{h) = Pi(0) + h{-fP^{0) + Q2(0) - gi(0)) + 0{h^) . 

We now set up the repeated interactions framework. The space of the system is 
R^. The environment is represented by the chain (M^)'^^*. The motion of the system 
is given by the following Markov chain 

'Qi{{n + l)h) = Qi{nh) + hP^{nh) + Oih?) 

Pi{{n + l)h) = Pi{nh) + h{-fPi{nh) + Q2{nh) - Qi{nh)) + 0{h?) . 
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The sequence (Qiinh), P2(^^))neN is sampled from the increments of a 2-dimensional 
Brownian motion. However, as previousy, states of the environment are reinforced 
by a factor 1/h. Hence, the Markov chain {X{nh)) is defined by 

X{nh) = U^''\X{{n-l)h),Y{nh)) 

where 

{X,Y)^X + a{X)Y + hb{X) + hr]^^^ (X, Y) , 

with 

\xj = [-x,-fxj^ ''[xj = [l ) ' 
and the remaining terms of Taylor's expansion are grouped together in the application 

Note that this last function could be explicitely determined from the equations 
of Newton's law of motion from which higher derivatives can be expressed. 



5 Convergence of Dynamics 

We leave for the moment our physical examples and come back to the general setup 
as introduced in Sections 2 and 3. In Subsection 3.2 a continuous dynamics T^'^^ 
related to T^'^) was defined on M"* x il. The convergence of T^'^^ to a continuous time 
dynamical system like (Tt) is now studied in this part. 

Each dynamics acts on a product space. Therefore, wc examine separately the 

functions on each component. More precisely, the convergence of the application 9^^^ 
to 9t for all t on is firstly regarded in the next subsection. Then, the one of the 
processes X^ to a solution of stochastic differential equation depending particularly 
on the application C/^'*) is studied. 

5.1 Convergence of Shift 

The space of the environment is Q, the set of continuous functions from R+ to R'^ 
vanishing at the origin. If the limit dynamical system exists, the space on which the 
shift acts has to be fl too. Therefore, we now consider the shift 6t on fl. Recall that 
it is defined by 

9t{u){s) = u{t + s) - u{t) , 

for all t, s in M_|_ and all uj. 
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The convergence of 6^ to 6t according to the natural metric D on for all t is 
shown in the next theorem. 

Theorem 5.1. Let uj he a function in VL. For all t e M_|_, 

lim D{et{uj),^P{uj))^Q. 

Proof. As for the proof of the lemma 1, this result is also based on the convergence 
of piecewise linear functions to continuous one on compact sets. However, note that 
two linear interpolations constitute the definition of 6^^^^ instead of one: one is due 
to the injection 0^^^ and the other one is due to the construction of the continuous 
dynamics on R"* x Q. 

For all cu G r2 and for all t and s in R_|_, we start by computing dt{oj){s)—9^^\u){s). 
By definition of T^l^\ the point 9^l^\uj){s) is obtained by linear interpolation between 
o (^(''))L*//^J o ct)f{oj){s) and (j^f o (^('^))(L*AJ+i) o (t)f{oj){s). Therefore, let us 
compute these two values. We have 

4>f o (^W)L*//^J o <pP{uj){s) = uj{{lt/h\ + ls/h\)h) - uj{[t/h\h)+ 

+ "~^'J^^^ {u{{[t/h\ + [s/h\ + l)h) - u;{{[t/h\ + [s/h\)h)} . 

On the other hand, 

^f) o (^W)(Lt//^J+i) o c^Piu){s) = uj{{[t/h\ + [s/h\ + l)h) - cu{{[t/h\ + l)h) + 
+ ^^^^jf^{io{{[t/h\ + [s/h\ + 2)h) - u;{{[t/h\ + [s/h\ + l)/i)} . 

Since of'^ (uj) (s) is a barycenter between these two points whose coefficients are given 



21 



by the linear interpolation on t, then 



h 

s — ls/h\h 
h 

t- [t/h}h 



■[u{{[t/h\ + [s/h\)h)- 



((lt/h\ + ls/h\ + l)h) - u((lt/h\ + ls/h\)h)] }+ 
{{[t/h\ + [s/h\ + 2)h) - u{{[t/h\ + [s/h\ + } 



^ s — ls/h}h 



(\t/h\+l)h-t t-\tlh\h , ,,,, 

- \ u{\tlh\K) ^J-^^{{\tlh\ + l)h) . 

As seen in the proof of the lemma 1, the term 

(U//iJ + t-\tlh\h , ,,,, 



tends to when /i goes to 0. 

We just have to prove now that the other terms converge to uj{t + s). As the 
function a; is continuous, we have 

lim|cc;((U//iJ + \slh\ + \)h)-uj((\tlh\ + \slh\)}i) \ =0. 

For the same reason, 

lim \oj{{\tlh\ + + 2)}i)-uj{{\tlh\ + + =0. 

ft— >-o 



On the other hand. 



and, obviously. 



~ h ~ '' ~ h ~ 



Q<»/''l + ^''-^<i. o<i^if/^<i. 
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Therefore, 

{\t/h\+l)h-t 



lim 



h 



s — [_s/ h\ h 



h 



X 



X \u{{[t/h\ + \_s/h\+2)h)-u{{[t/h\ + [sAJ =0, 



and 



lim 



t- \ t/h\h 



h 



s- [s/h\h 



h 



X 



X \^{{\t/h\ + [s/h\ + l)h)-u{{[t/h\ + =0. 
For the same reasons as previously, the remaining terms 

(Lt//,j + i)h-^^^^^^^^^ ^ ^^^^j^^^ ^ i:iI^^((Lt//,j + [_s/h\ + 



tend to ^(t + s). 

As a conclusion, for all t, s in R+, we have 



h 



lim 



= 0. 



Since the interval [0, n] is compact, by uniform continuity of these applications 

0. 



lim sup 

h-^O o<s<n 

Finally, by Lebesgue's Theorem, 



The theorem is proved. 



□ 



Eventually, the application 9^ converges to the shift 9t when h goes to for all t 
on Q whatever be the continuous time dynamical system as long as the noise of the 
stochastic differential equation is a d-dimensional Brownian motion whose canonical 
space is Q. 



23 



5.2 U and Almost- Sure Convergence 

After having studied the convergence of the shift, we want now to give conditions 
on f/*^^) for the W and almost sure convergence, on every time interval [0,r], of the 
process X^ , the first component of , to the solution Xt of a SDE. 

As the process X^ is just a linearly interpolated Markov chain, this convergence 
boils down to the convergence of some schemes of stochastic numerical analysis. 
Thus, our result belongs to a more general problem, that we shall apply later on to 
the process X^ in Theorem 5.3. 

Consider the solution Xt in starting in Xq of the SDE ([1]) 

dXt = b{Xt)dt + a{Xt)dWt , 

where [Wt) is a (i-dimensional Brownian motion, and where the applications b and 
a, respectively from R"^ to and from to A4m,d{^), are Lipschitz. Recall that 
this assumption is required for the existence and the uniqueness of the solution of 
the SDE on every time interval [0, r] and for all initial conditions. 

Let {X'^fjnen be a Markov chain for a time step h whose evolution is given by 

with Xq = xq and where rf^^^ is a measurable application. 

Note that the form of the equation above is identical to the ones previously seen in 
the physical examples. Also note that, without the term ri^^\ the scheme above is the 
usual stochastic Euler one. Hence our context is more general than the usual Euler 
scheme for the discrete-time approximation of SDE. We have to adapt convergence 
theorem to this situation. 

The Markov chain (X^^) is now linearly interpolated to obtain a continuous time 
process (X/')(g]R^ defined by 

Vh _ vh I ^ ~ LV^J ^ ( yh yh \ 

- ^\t/h\h \^{\t/h\+l)h - ^\t/h\hj 

= X[t/h\h H ^ {(^{X\t/h\h){W{\t/h\+i)h - W\t/h\h) + 

+ + h4^\x[,/,^,, W^(L*MJ+i)/. - Wyt/H\^)] , 

for all t, and with Xq = Xq. 

For the convergence of the process X/^, we make one more assumption to control 
the term in ri^^\ 
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(H4) There exist a g]0, +oo] and K2 such that 



We start with the main result on the convergence of processes in the case of globally 
Lipschitz functions. 

Theorem 5.2. For all t > and for all p > 2, under Assumptions (HI) and (H4), 
the process (Xj^) converges in to the solution {Xt) of the SDE ([T]) on [0,r]. 
More precisely, for h small enough and p = 2q with q > 1, 



E 



sup ' < C(/i2«" + /i«-^(-log/i)^ 



where C is a constant depending only on t, q, Kq and K2- 

Moreover, if q is such that q > 2 and 2qa > 1, then the convergence is almost 
sure on [0, r] . 

In order to prove this theorem, we use the same strategy as Faure considered in 
his PhD thesis ([3j) for the convergence of the explicit Euler scheme, i.e. without the 
term hrj^'^K Before hands we need two long and technical lemmas 15.31 and [5.51 and a 
property on solution of stochastic differential equation. Lemma 15.41 These lemmas 
shall be applied in the proof in the case of locally Lipschitz and linearly bounded 
applications because the linear growth condition shall be the key property. 

The first lemma gives an inequality on the L^'^-norm of some stochastic processes. 
In order to obtain this result, the definition of a L^-continuous process is introduced. 
A process Yt is -continuous if the function t 1 — > E \\Ytf] is continuous. 

Lemma 5.3. Let Yt he a process defined by Yt = Yq + J^AsdWs + J^Bsds , where 
As and are L?'^ -continuous, and E [|lon < 00. Then Yt is -continuous. 
Moreover, 



E[|r,n<E[|ron 



t 

'0 



Proof. First, by the convexity of the function x 
non- negative reals 



/+|5,|P]cis. (2) 
x*^, we have for all x, y, and z 



[x + y + z 



,29 



Hence, 



^[\Ytr] <c2M[\Yor] +E 



AsdWs 



2gi 



+ E 



-B, ds 



2qi 
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By Holder's inequality we claim that 



E 



Indeed, first note that 



i?„ ds 



2q 



<Cot"^-^ / E[|5,|'^] ds. 



(3) 



-Bo ds 



2q 



E 

i=l 



Bids 



2\q 



Component by component, we have by Holder's inequality, 



E 



Bids 



2q 



\Bl\'' ds 



By the convexity of the application t i — y we have the announced inequality 
For the second term, there exists Burkholder inequality based on Ito's formula which 
gives a similar bound: 



E 



A. dW.. 



<Crt^-^ / Efll^ll^"] ds. 
Jo 

Finally, we have obtained the following bound 

E [lY.f^] < C2q(E [\Yof']+Cot"^-' O^^l'l ds + Cfi-' j\ [P.f'^] ds) . 

Now for the L^-continuity of this process, Ito's formula is applied between two times 
s,t with s < t to the process {Yt). Indeed, since the application x \ — )■ is twice 
differentiable for g > 1, we get 

m „t 

\Yt\''' = \Ys\'' + J2 ^q\Yu\''-'Y:dY: + 
i=l -^^ 

+ ^ E / - 2) \Y^\"^-' Y^Yl d{Y\ Y^)^ + 

+ ^ E / 2g(2g - 2){Y:f \Y^\^'-' + 2q \Y^\"^~' d{Y\ F% 



where Y^ = {Y^)i=i, 
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From the definition of K 



d 



we liave 

d d d 

d{Y\ = Y,Y. "^"^ d{WV)^ = ^ A^A^' du . 

k=l 1=1 k=l 

Hence we get 

m „t m d „t 

\Y,f'^=\Y.,f' + 2qJ2 \Yu\"'-'Y:B:du + 2qJ2J2 l^f'^'^A^ dWi + 

+ 2q{q - 1) E E /* l^'^l''"' ^Y^A^A^ du+ 
i,j k=i -^^ 

m d „f 

.■1 ! 1 J S 



1=1 k=l 

Taking tlie expectation, we obtain 



¥.[\Y,\"^] =E[|r/«] +2g5^ / ^[\Y^\"^~'y:BI\ du+ 

i=i 

+ 2q{q-l)J2tl f^ilYuf'-'Y^Y^A^'^A^''] du+ 
i,i k=i -^^ 



m d 



i=i k=i 



Hence, 

\^[\Yt\''] -E[|F/^]| <Ci l\[\Y^\''-'\Bu\] du+ 

J s 

+ C2iy[\YX'''\\Au\\'] du. (4) 
Consider tlie first term in Inequality (jlj). By Holder's inequality we have 

E [lY^l'"-' \B^\] < E [Kf^f'-'^^'' E [\B^n'^'' . 
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In the same way for the second term in (jlj) we get 
Therefore, 



Since E [ly^l^'^] is bounded for sX\ s <u <t and by the L^-continuity of and i?^, 
one can conclude that the process Yt is L^-continuous. 

Let us proceed now with the proof of Inequahty ([2]). By Ito's formula between t 
and we have 



m „t 

\Y,\"^ = \Yof' + J2 2q\Y/'^-'Y:dY:+ 

+ \Y.f 25(2? - 2) \ys?'-' Y:Y^d{Y\ 

+ ^ E r 2^(2g - 2)iY:f lYf''-' + 2q \Yf'~' d{Y\ F% . 
Jo 



Hence, taking the expectation we get 

m „t 



E[\Ytf'] =E[|yo|'1 +2gV / E[\y:\''-' Y:B'^ ds+ 

i=i Jo 



+ / EOnr^(Af)^] rf.. (5) 
i=i k=i Jo 



Let us start with the last term of the ([5]). First recall that 

m d 



i=l k=l 
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Note that, for all k in |0, 2g| and x, y in M, we claim that x^'^'^y'' < a;^^ + ?/^^. Indeed 
we have < 1 + Y^'^, for all F in M and we apply it to Y = y/x (if x = 0, the 
inequality is clearly true). Therefore we get 

m d 
i=l k=l 

Now consider the first term in ([5]). If the scalar product on R"^ is denoted by ( , ), 
then 

m 

Y,\ys?'~^Y:Bl = \Ys\^'^-\Y,,B,) < \Y,\''-'\Bs\ . 

i=l 

From the previous inequality, one obtains 

m 
i=l 

Let us consider now the last term of ([5]). Note that. 
Hence, 

d 

i,j k=l 

In conclusion, there exists a constant C such that 

^[\Ytf'] <E[|ro|'']+C fE[\Yf'+\\A,p + \Bsf'] ds . 

Jo 

The lemma is proved. □ 

The next lemma (proved in [6]) gives some regularities of trajectories of solutions 
Xt of the SDE 1^. 

Lemma 5.4. Let [Xt) be the solution of ([T]) for all t G [0, r]. Suppose that the maps 
b and a are locally Lipschitz (H2) and linearly bounded (H3) . 
Then, for all t G [0, r] and for all q < I, 

E[\Xtn <(l+E[|xo|'''])e^*, (6) 
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and, for all t, s such that t > s, 

E [\Xt - X/«] <D{1+E [\xo\'']){t - s)''e^(*-^), 

where C and D are positive constants depending only on t, q and Ki. 
Moreover, for all t > 



(7) 



E 



sup \Xt 

te[o,T] 



|2g 



< +CX) 



For the convergence of the process to Xt the main tool shall be Lemma [5.31 
However, notice that the evolution of X^ doesn't allow to apply this lemma because 
of the linear interpolation. More precisely, for all n, between the times nh and 
{n + l)h, this process is not of the form + As dWg + /^^ Bs ds. Therefore, in 
order to apply it, it's natural to introduce the new process Y^^ defined by 



Jlt/h\h 



+ I cr{Yll/,^,)dWs. 

'[t/h\h 



Note that 



Yin+i)h for all n. 



The last lemma gives equivalent bounds as in Lemma 15.41 but for the processes 
(X^) and (¥1^). 

Lemma 5.5. Let (Xf ) and be the processes defined above. Suppose that the 

maps b and a are locally Lipschitz and linearly bounded. Moreover, suppose that 
Hypothesis (H4) are satisfied. Then, for all t G [0, r] and all q > 1, 



E[\X^\'']<Co{l+E[\X^\''])e 



-\\^C'it 



and, 



Moreover, for all t and for h small enough. 



(8) 
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and, 

- nUj/^f'] ^ + h'i-ioghy) . (9) 

On the other hand, for all h < Hq, 

E[(sup|F,^|)2^] <C3(l + E[|X^f^]), 

t<T 

where (Cj) are constants depending only on t, q, Ki and K2. 

Proof. Before the proof, we want to note that Assumption (HI) imphes the fact that 
the functions h and a are hnearly bounded. More precisely, there exists A'l > such 
that 

\h{x)\<K^{l + \x\) and \\a{x)\\ < Ki{l + \x\) . 

This hnear growth property shall be often used in the following proofs. 
The proof of this lemma is achieved in several steps. 

The first step is to bound E[|Xj'^|^''] according to EflXf^/^j^l^" ] . Prom the 
definition of X^, we have 

The process at time \t/h\h is independent of W(^\t/h\+i)h — W\t/h\h- Therefore, 
by the linear growth property, we get 

+ /i2^E[|r/^(4,/,j„W^(L,/,j+i),-W^Lt//.J/^)r'])- (10) 
In the same way as above, the following bound can be found for {Yl^): 

E[ ] < (e[ iF^wr' ] + + ^nnwri )+ 

+ C,Kl\l + E [ f ^ ] )E [ I m - Wy,/n\H\"' ] + 
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The next step is now to bound E[ |W^([t//iJ+i)/i ~ ^L*/'»J'»r'' ] 

E[ — W^[t//ij/i|^'^] • By definition of the norm, one can find an upper bound by 
regarding the supremum of d 1-dimensional standard Brownian motions {B^)k=i...d 
on the time interval [0, h\. Thus, consider the process Mh defined by 

Mh = max sup I . 
The aim is to find a bound on E \Mf^\ ■ Firstly, note that. 



E [M^«] < E 



7i^2q -ji 

^ [Mh>2^h{-\ogh)] 



But, 



E 



< 



d 

VEf( sup IR'^ 1)25 Ir , ; 

^ LVro^' I sup \B'^\>2y^h{-\ogh)\ 



By using the reflexion principle we get 

d 



E 



< 2 



k 

<C2 



VEf( sup R'^)^'' Ir , ri T\ 

fe=i '■tep.h] 



i;>2y;i(-log/i) 



where 5f(a;) = 2 e ^"^^ / y/^nh . 
Hence, 



E 



Ju>2V-log/i 



Let us compute now this integral. By integration by parts, we have 



u 



u>2\/— log h 



U 



2q-l(_^-uy2 



2V-Iog/i 

^2,-2g-.V2^^ 



+ (2g-l) / 

-'u>2V-log/i 

<2v/^b^)25-ie-(2^'^'/2 + (2q - l)7,_i 
<2y^b^)25-i/i2 + (2g - 1) Vi . 
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By recurrence, Iq < C4(a/— log h)^*^ ^h^. Therefore, for h small enough, 

E[Ml'^] <C,h'^i-\oghy. 

Thus, we obtain 

E[\W(^^t/hi+i)h - W^t/hihl''] < a/i^(-log/^)^ 

and 

Then, from Assumption (H3), 

+ E[\W^lt/h\+i)h-Wit/hih\^'']) 
and with the previous inequality on E[ — , 

+ Ch^i- log hf). (12) 
Hence, for h small enough, Inequilties ( ITOl) and ffTTl) becomes 

E[ \X^\''] <Cs[{l + h"^ + h'^i-loghY) E[ IXfi/.j.f'^] + h"^ + h'^i-logh)") , 

(13) 

and, 

E[ |v;'r'] <Cs[{i + h'" + h\-ioghy) E[ + h"^ + h'^i-ioghy) . 

(14) 

These inequalities allow us to bound the expectation of the norm of the processes 
and Y/^ according to the time in hW just before. 

The next step is to understand how the norm of this process between two suc- 
cessive times in hW evolves. In other words, we want to study the evolution of the 
norm of the Markov chain (X^^) = (Y^j^). 

Recall that 

+ /ir/W(X„\,l^(„+i),-iy„,). 
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This can be also written 

»(ra+l)/i 



XUdH = + / + v\X^nK, W^(n+l)h " W^nh)) ds+ 

J nh 

l'(n+l)h 
J nh 



One obtains from Lemma 2 between the times nh and (n + for the process Y^^^f^ 
that 

J nh 

The value of E[|F/| "] can be bounded with (fl^ . Hence, for h sufficiently small, 
and from the linear growth property, it follows that 

E[|^(Wr'] <{l + C^oh)E[\X^'']+C^,h. 

Note that, the sequence (E[ |X^^|^^])„gp} is subarithmetico-geometric, that is, this 

sequence has the following form Xn+i < Pxn + 1 where /3 > 1. Thus, each E[ |X^;,| 

can be controlled by only E^IXqI^"^] and the time n. Indeed, if a sequence (x„) 
satisfies the previous inequality, then, for all n, 

Xn < /9"a;o + ne""^^-^^-/ . 

Therefore, for all t in [0,r], 

n\Xft/hih\"'] <il + C,ohf'E[\X^\'']+le^^^^Cnh 

Hence with Inequality ( fT3l) . 

E[\Xlf'] < C7i2(E[|Xo^|''] +Ciit)e^i°* 
<Ci3(l + E[|Xo"f'^])e'=^^°S 

and, for the same reason, 

E[|r,^|"^] <Ci3(l + E[|Xo^|"^])e^^o*. 
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Let us proceed now with the proof of Inequahty (Q. For all t, we get 

+ lk(^[t/ftj/i)f^ \W(^it/h\+i)h - Wit/h\h\'^'^ + 

Then, we have 

|2g 



- XlVj.IT < C8((/^^« + /.''l- log/^)'')E[|X[l/,j,|^^] + 

Finally, from the bound ([8]) on E [ | X^^^^j ^ | ^'^] , we obtain 

E[ |Xf - Xf,/,j,f^] < Ci4(/^'^ + /i«(-log/i)^) 
and the same reasons 

^[\yl'- yvmHt'] < Cu{h'' + h'^i-ioghy) . 

We now proceed with the proof of the last inequality. Note that the process Y/^ can 
be also written by this way 

"^0 fc=0 

We define the process by 

= sup|r,'^|. 

s<t 

The aim is to find a bound on E[(Zj'^)^'^] independent of h. 

Note that from the definition of the norm and the convexity of the applica- 
tion X I — y \x\'^, 



i=l 
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where Zf'* is defined by Z^'' = supg<^i\Y^^'^\. Therefore it is sufficient to bound 
component by component. For all i e [|1, m|], by the triangle inequality, 



E[\Z^'f']<C,,{E[\Xof''] + 

iL]kh,(k+i)h]{U){u \ikh)^ ''r K^kh^ ff(fe+i)fe - vvkh)) uu\)'^'^ 

k=0 



+ E[(sup| / Yl hkk,ik+i)n]{u){b\Y,\) +7j^^^'\Y,\,W^,^,)f,-W,^^^ 

s<t Jo 



+ E[(sup|/ Y.T.hkk,(k+i)h]{u)a'''{Y,\)dWl\f]). (15) 

-^0 k=0 j=0 

Consider the second term in this inequality. By Holder's inequality, 

E h'^k,ik+mi^)ib\Yl^,)+r^^'^^'\Y,\,W^,+,), - W,h)) dul'" < 

k=0 

<s'^-' / I J2 t]kh,ik+m{u){b'{Y,\) + v^''^'KY,\,W^^^ 

•^0 k=0 

Note that this sum over k is reduced to one term for each s. Hence, 

10 



•^0 k=0 

<C,r Yl hkh,ik+m{u){\b\Yll)\'' + |r?('^)'Xn'k, W^M/. - W,h)\'') du. 
Jo 



From Assumption (H3) and the linear growth bound on the function b, 

•^0 k=0 

-^0 k=Q 

Since we are interested in h small, we can consider h < 1. Therefore, since t < t, we 
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obtain 

\T/h\ 



s<t Jo fc^o 

< Ci9(l + / mztY'] +E[ ^ t]kh,ik+m{u)\W^k+i)h - Wj,H\'']du. 



Recall that for each u the sum over k is reduced to one term. Since each term can 
be bounded by h'^{— logh)'^ as previously shown, then, for h sufficiently small, 

E[(sup| / 5^ V,(,+i),](«)(6^(F,'),)+r/W'^(y/^,,l^^^^^^ < 



s<t Jo 



k=0 



Jo 



Consider now the last term in Inequality (1151) . By Burkholder Inequality, we get 

[r/h\ d 



JO k=0 j=0 

^0 7 — n ^ — n 



A; = j=0 

From the the linear growth bound of cr, we obtain 



JO k=0 j=0 

Jo 

Finally, we get 

E[|z,^fT<c,3(i+ f\mY']du), 

Jo 



and then. 



Jo 
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Hence, by Gronwall's lemma, 

where C25 is independent of h. □ 

Proof. Theorem 5.2. For all positive r, the same strategy as in the proof of Lemma 
15.51 is set up to show the convergence on the time interval [O, r]. 

The error between the solution Xt of the SDE and the process is denoted 
by et. Let us begin with a formula which lies the errors at two consecutive points of 

e(n+l)h =X{n+l)h - X\^n+l)h 
/■(n+l)h 

=enh+ / cr{Xs)-a{X^,,)dWs+ 

J nh 
j-{n+l)h 

+ / h{X,) - - r^'^(X„\, W^r.+i)H - W^nh) ds . 

J nh 

As previously seen. Lemma 15.31 is applied to the process {Xnh+t — ^nh+t) instead of 
^nh+t because of the linear interpolation in the definition of X^. Then, we get 

J nh 

+ E[||a(X.)-a(Xi)f^] + 

+ E [ 1 6(X,) - 6(X„\) - r/'^ (X„\, - | ^'])ds. 

Or, 

Xs — = enh + Xs — Xnh + Ynh ~ ■ 

Then, we obtain 

From Lemma 15. 4[ 

E[ |X, - X„,|''' ] < C2(l + E[ |Xo|'' ]){s- nhy < C^h'^ 
For the process Y/^, Lemma [5.51 gives the inequality 

^l^s^ -yl]^'] < c^ih^'i + h'^i-ioghy). 



38 



Therefore, for a small h, 

¥.[\X,-Y^\''] <C,{¥.[\er,u\^'^]+h^{-\oghY). 

Since (7 is a Lipschitz function, 

E[||a(X,) - < Kl'^ E[ |X, - X^J"] 

< Kl'^ E[ |X, - X,;, + X^h - ^if' ] 
<C6(E[|e„^|''']+/i^). 

On the other hand, the last term can be also bounded 

< C,{¥.[\h{X,) - +E[ \v\X^^n.Wi^^+i)H - W^nOf']) ■ 
AsE[|X^,f^] is finite, 

E [ \v\X^H. W^n+i)h - W^n)\^' ] < K(h^(- log + h'^^) . 
And, finally, we have 

E[\b{X,) - biX::^) - r)\Xl^, - W^nt'\ < CglEf |e„,|^^] + 

+ /i«(-log/i)^ + /i'^"). 

Thus, for h sufficiently small, 

E[|e(„+i),|''] <E[\enhf']+Coh(c,(E[\enHf'']+h''{-\oghy) + 

< (l + C9/i)E[|e„fe|'^] +Cio/i^+^(-log/i)« + Cn/i'+2^". 

Note that (E[ |e„/,|^'']) is an other subarithmetico-geometric sequence. Hence, as 
eo = 0, 

E [\enh\^'^] <ne"^^'*(Cio/i''+^(-log/i)'^ + Cn/i^+2«°) . 
On the other hand, 

et = ^\t/h\h + Xg — Xnh + ^n/i ~ -^s ■ 

39 



Therefore, for a time t in [0, r] 



E[\et{"^] <C,{E [\eit/hih\''\ + log/i)^) 

<C5[U'^''^'''{Cioh'^+\- log hy + Cii/l^+2ga) ^ /i<?(- log /i)?] 

<Ci2(/i^(-log/i)« + /i2''"). (16) 

Eventually, a bound on E[ |Xt — is found. However, we want to prove the 

inequality on the supremum 

E[( sup letlY"] <C{h^'''' + h''{- log hy). 

tG[0,T] 

Let us proceed with the proof of this inequality. From the definition of the norm and 
the convexity of the application x \ — )■ \xf, 

m 

E[( sup |e,|)'T <Ci3$:e[( sup 141)^. 

*e[o,r] -^^ te[0,r] 

Thus, it is sufficient to control the supremum of each component. 
For all i in [|1, m|]. 



•^0 fe=0 

•^0 k=0 j=l 
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Then, 
E[( sup 

tG[0,T] 



2gi 



<Ci4(E[( sup I / {h\X,)-h\Xl) + 

tG[0,r] Jo 

- (77^'^) )^ (X,\, -Wkh)] t]kHXk+m {s)ds\Y'] 

+ E[(sup I / J] J]{a^'^'(X,)-a^'^-(X,\)}l],,,(,+i),K^)rfW^i|)'T 

te[0,r] Jo fc^o 



+ E[( sup I <y^'Kx[t/n^H){Wl - 



Consider the first term of (1171) . by Holder's inequality, we get 

\T/h\ 

Pl/" 

ie[o 



E[( sup I / {HX,)-h\Xl^) + 

ie[0,T] Jo i._n 



A;=0 



Note that, for all s, the sum over k is just composed by only one term, thus 

Lr/hJ 

■ , S 

te[o,r] Jo ;.,^o 



E[sup I / 5^ l&X^.) - &'(^'.) + 
te[o,r] Jo ^,^0 

<Ci5 / E[^ |6^(X,)-6^(X,\)+ 

Jo ,_n 
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Or, from previous inequalities on processes, 

E[ sup I / {h\X,)-h\Xl^) + 
te[o,r] Jo 

<Ci6(/l^(-l0g/l)'' + /l2«"). 

Consider now the second term of f lT7|) . By Burkholder's inequality, we obtain 



< Ci7E[ / I 5^ Y.^a^"^^s) - cr''{Xl^))t\kH,ik+i)HM''ds\ 

"'O fc=0 3=1 



k=0 j=l 

Therefore, from Assumption (HI) and the bound on et 



<Ci8(/i''(-log/i)5 + /i29") 
Let us proceed with the remaining term of (ITTIl . Note that 



E[( sup \ J2^'''(^m\>^){^t-wl,^,^,+ 



ie[o,T 



t-[t/h\h J ■ 

^ l*^'^(Lt//iJ+i)fe ^^[t/h\h)f\) J ^ 

< C,,E[ sup k^'^'(Xf,Mjjr'^ sup ll^i - W/^,/,j,r^)] 

te[o,r] ^ se[Lt/'iJ/i,(Lt//iJ+i)/i] 

d 

<C,,E[ sup ($^|a^'^'(X^,)r'^ sup \W^-Wl,\'')] 
fce[|o,LT/feJ|] ^.^^ se[fcfe,(fc+i)fe] 
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Since the supremum of non-negative elements is less than the sum of this elements 
and from the linear growth bound on a, we get 

d 

E[ sup I a^'^ (X,\) I sup I Wi - Wl, \'')] < 

ke[\o,lT/h\\] ~[ s(^[kh,(k+i)h] 

Vr/h\ 

< C2oE[ 5^ (1 + \Xl^\'') sup \Wl - Wi^\''] 

k=i s<^{kh,{k+l)h] 



Since E[ sup | "^j is finite (Lemma 15.51) . by independence of increments 

te[o,T] 

of Brownian motion and, from the bound on the supremum of these supremum on a 
time interval of length we obtain 



E[( sup \ Y.<''^Kx[„n^n){Wi-Wl,,,^,+ 

_t-\t/h\h . . OU2,. 

^ {\tlh\+l)h ^^\t/h\h)}\) \ ^ 

<C2l[T/h\h''{-\0ghY. 



Finally, we obtain 



E[( sup |e^|)^'] <C22{h''~\-\oghy + h^'''^) . 

te[o,T] 



And, therefore, we have 



E[( sup IqI)""] < C22(/i''-'(-log/i)'^ + /i2«°). 

te[o,r] 

This inequality implies the convergence in W of the process {X^) to (X^) on [0, r] 
when h tends to 0. 

For the almost sure convergence, we suppose also that the exponent p is such 
that p > 2 and pa > 1. 

Thus, the previous result gives 

oo 

Ve[( sup \X,-Xl/'\Y']<oo. 
k=i 
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As (sup(g[Q^^] \Xt — xl^''\Y'^ are non-negative random variables, then 

lim sup le^l =0 a.s. . 

□ 

From the convergence of this scheme of stochastic numerical analysis, the main 
result on the convergence of the process to a solution of a SDE is deduced. 

Theorem 5.6. Suppose that there exist measurable maps b, a, and rj^^'' which verify 
Assumption (HI ) for b and a, and (H4 ) for i]^^^ such that the application on the first 
component of T^^^ is of the following form, 

[/W (x, y) = X + a{x)y + hb{x) + hrj^'^^ {x,y) . 

For all Xo in MJ^, and all t > 0, let Xf" be the solution on [0, r] of the SDE 

dX^° = b{X't')dt + (j{X^'')dWt . 

Then, the process {x'l), starting in xq, converges to when h tends to in L'^, 

for all p > 2 on [0, r] . 

Moreover, the convergence is almost sure on [0,r]. 

We now present a similar result in the case of locally Lipschitz and linearly 
bounded applications b and a, that is to say satisfying Assumptions (H2) and (H3). 

Theorem 5.7. For all t > 0, under the assumptions (HI), (H2), and (H3), the 
process (X^) converges in to the solution (Xf) of the SDE ([T]) on [0, r] for all 
p>2. 

More precisely, 

\imE\{ sup IXi -Xflfl =0. 

Proof. For all r > and all natural N, we define two stopping times tj^ and r^'' by 

tn = inf{t; \Xt\ > N} and r^^^ = inf{t; |xf ^| > X} . 
Note that, from Theorem I5.2[ 
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where Cn notably depends on K 



N- 



Arjv t/\T^ 

+ E[( sup |X,Y'+|X,f^:rJf)<r] + 

tG[0,T] 

+ E[( sup |xf|"^+|Xt|'':rjv<r]. 



■ie[o 

Hence, we get for all N 
Eff sup |Xf-XJ)2'?l <Er sup IX'^ (,) -X^ (,)^ + 



+ ^E[sup |X,Y^-*-^+ sup IX.l''-"']. 
te[o,T] te[o,T] 



Since the expectation of the supremum of Xt (Lemma 15. 3p and the supremum of 
(Lemma 15. 4p can be bounded by a constant independent of h for all h sufficiently 
small, then 

limE^sup \Xt-Xj^m =0. 
'^^0 te[o,T] 

□ 

This theorem 15. 71 implies the following result on the limit evolution of the system 
when the time step h for the interactions goes to 0. 

Theorem 5.8. Suppose that there exist measurable maps h, a, and rj^^^ which verify 
Assumptions (H2) and (H3) for h and a, and (H4-) forrj^^^ such that the application 
on the first component of T^^^ is of the following form, 

U^^\x, y) = x + a{x)y + hb{x) + hr]^^\x, y) . 

For all Xo in W^, and all r > 0, let X^° be the solution on [0, r] of the SDE 

dXf = h{Xp')dt + (j{Xt'')dWt . 

Then, the process (X^), starting in Xq, converges to (Xf°) when h tends to in L'^, 
for all p > 2 on [0, r] . 
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Physically, the results of these two theorems of convergence can be understood 
as follows. If the effective action of the environment on the system is roughly linear, 
the limit evolution of the system is given by a solution of a stochastic differential 
equation. This SDE is deduced from a Taylor expansion of the application U^^\ 

With the quantum repeated interactions scheme, Attal and Pautrat (in |2j) find 
quantum Langevin equations as limits of some Hamiltonian systems. There are some 
similarities with their results, particularly on the form of considered interactions. 



6 Back to the Physical Systems 

6.1 Charged Particle in an Uniform Electric Field 

The first example was a charged particule in an uniform electric field. Recall that 
the evolution for a time step h is given by 

X{nh) = U^''\X{{n-l)h),E{nh)) , 

where the map U^^^ is defined by 

U^^\x, y) = X + a{x)y + hb{x) + hT]^{x, y) , 

with 



a 




Note that this application U^'^^ is of the form of Theorem 15.61 The function a is 
constant and the function b is linear. Finally, they are Lipschitz functions. For 

the application t]^, Assumption (H4) is also verified with a = +oo and K2 = . 

2m 

Therefore, Theorem 15.61 can be applied for this system. 

For all intial Xq and pq, all r > 0, the limit process which gives the evolutions 
of the charged particule is almost surely the solution Xt = ( ^2 ) on [0, r] of the 



stochastic differential equation 



X? 



dXt=\^ ™ jdt+(^^^j dWt, 
where Wt is a 1-dimensional standard Brownian motion and with Xq = {xo,Pq) 
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6.2 Harmonic Interaction 



The second example was a harmonic interaction between the system and the envi- 
ronment. The evolution of the system was descibed by the Markov chain 



where 



with 



and 



X{nh) = U^''\X{{n-l)h),Y{nh)) 



U^^\X, Y)=X + (r{X)Y + hh{X) + hT]^^\X, Y) , 



Xi 
X2 



X2 

-(xi + l) 



a 



Xi 
X2 





1 



V 



(h) 



Xi 
X2 



yi 

1/2 



+ o{h) 



dX, 



starting at time in Xq 



dt 





1 



dW^ 



1 1 



2\y2 ) 2\ X2 + 2yi/3 

The functions h and cr are Lipschitz. For the application ri'^^\ Assumptions (H4) is 
verified too for a = 1. Theorem 15.61 can be applied for this system. Therefore, we 
conclude that for all r > and all Qi(0), -Pi(O) in M, the limit evolution on [0,r] 
of the system is given almost surely by the solution of the stochastic differential 
equation 

-{XI + 1) 
Qi(0) 

Note that this SDE is the equation of a harmonic oscillator perturbated by a 
Brownian noise. This kind of SDE was already considered in [8j for instance. 

Let us focus now on the asymptotic behaviour of this process. This stochastic 
differential equation has no stationaty measure since the non-perturbated differential 
equation has no stable point. Physically, the energy of the system whose evolution is 
governed by this SDE inscreases with the time. This rise of energy can be explained 
by the fact that repeated interactions bring energy to the system and there is no way 
to dissipate it. The next example shall be different. 



6.3 Damped Harmonic Oscillator 

The last example is the damped harmonic oscillator. The system undergoing repeated 
interactions evolves following the Markov chain {X{nh)) defined by 

X{nh) = U^^\X{{n-l)h),Y{nh)) 
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where 



U^''\X, Y)=X + a{X)Y + hb{X) + hrj^^^X, Y), 



Xi \ f X2 \ f Xi \ / 



with 

^ ( X2 y V -Xi - fX2 J ' ^ \X2 ) V-'-^ 

The apphcation rf^^^ is not exphcitly expressed. But as said in the section 4, from 
Newton's law of motion, high derivative of Pi and Qi can be bounded with Qi, -Pi, 
Q2 et P2- Then a required bound on r/'^'*) can be found. Moreover, the maps 6 et o" 
are Lipschitz. Therefore Theorem 15.61 can be applied. 

Hence, the limit evolution of the system is governed by the solution of the stochas- 
tic differential equation 

= Pidt 

-- -f Pi-Qidt + dWl . 

Note that in all these examples, the states of parts of the environment are sampled 
from the increments of a Brownian motion whose variance is 1. A new parameter 
which could be interpreted as the temperature of the environment can be added by 
taking a variance T. Mathematically, it can be introduced by multipling states of 
the environment in the setup of repeated interactions by a factor a/T. Physically, 
more the temperature of the environment is high, more the interaction with the 
environment influences the dynamics of the system. The effect of this temperature 
is the change of the diffucion term. The new stochastic differential equation is 





- Qidt + VT dW:^ . 

Then, we examine the asymptotic behaviour of the system. This stochastic differen- 
tial equation is a Langevin equation whose stationary measure is given by the Gibbs 
measure 

C ■> 2T 

d fx = — dQidPi , 

Z 

where ^ is a normalizing constant. 

Contrary to the previous example, the friction force allows the system to dissipate 
a part of its energy and then, the convergence of the dynamics to the stationary state 
(see [7j). Physically, this convergence to this Gibbs measure can be understood as 
follows. The repeated interactions of the environment at temperature T lead the 
system to tend to the thermal state related to the same temperature T. Finally, the 
system is thermalised by the environment. 
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